Skip to content

Clean up - #180

Merged
DanWeinberger merged 7 commits into
mainfrom
clean-up
Jul 30, 2026
Merged

Clean up#180
DanWeinberger merged 7 commits into
mainfrom
clean-up

Conversation

@anshap32

Copy link
Copy Markdown
Collaborator

In response to the following points from Micah:
-remove all manual process.json writing from ingest scripts (e.g., nccr, and anything with that common pattern)
-review process files that were manually created, as they may not have scripts defined (e.g., yrbss, epic_health_alerts)
-review copied process files for leftovers, e.g., source_files entries in source type projects like in wastewater_measles
-remove garbage (e.g., raw, status.html, data/-, data/process.json, copied files tagged with MWMJ0G3P8D)
-census has parquet files in raw seemingly not used elsewhere
-narms has xlsx files that can be much more efficiently compressed

@anshap32
anshap32 requested a review from DanWeinberger July 29, 2026 17:37

@DanWeinberger DanWeinberger left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Retain the parquet files on /census, everything else looks OK (commit [16ef4ba])

anshap32 added 2 commits July 30, 2026 09:27
Conflict resolutions:
- data/bundle_injury_overdose/dist/heat_risk.parquet: kept. It is still
  generated daily by data/noaa_heat_risk/ingest.R, so its removal in the
  cleanup was incorrect. Restored its measure_info.json entries too.
- kinsa_ili / noaa_heat_risk process.json + datapackage.json: took main's
  fresher run state and hashes, minus the -MWMJ0G3P8D ghost-file entries
  this branch removes. Kept the noaa_heat_risk process.json name fix.
- docs/index.html and resources/data_manifest.json: regenerated with
  scripts/build_docs.R.
@anshap32
anshap32 requested a review from DanWeinberger July 30, 2026 14:34
@anshap32

Copy link
Copy Markdown
Collaborator Author

Restored files.

@DanWeinberger
DanWeinberger merged commit 80cc36c into main Jul 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants